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Abstract 

The restricted isometry property (RIP) has become well-known in the compressed sensing 
community. Recently, a weaken version of RIP was proposed for exact sparse recovery under 
weak moment assumptions. In this note, we prove that the weaken RIP is also sufficient for 
stable and robust sparse recovery by linking it with a recently introduced robust width property 
in compressed sensing. Moreover, we show that it can be widely apply to other compressed 
sensing instances as well. 


1 Introduction 

The concept of restricted isometry property (RIP), which was introduce by Candes and Tao in [3], 
has become well-known in the compressed sensing community. Recently, a weaken version of RIP 
appeared in [7] as an important tool for exact sparse recovery under weak moment assumptions. 
In this note, we prove that the weaken RIP is also sufficient for stable and robust sparse recovery. 
A key observation is that the weaken RIP implies the robust width property, which was proposed 
in [2] and allows uniformly stable and robust recovery for many instances in compressed sensing 
M. We establish our discovery in a very general form by introducing the concepts of atom norm 
and simple subset, and hence other instances in compressed sensing such as low-rank recovery are 
commonly covered. The results in this study indicate that the weaken RIP plays a vital role similar 
to the original RIP. 


2 Robust width and weaken-RIP 

2.1 Robust width property 

The robust width property was formally defined in [2]. Before stating its definition, we first intro¬ 
duce some notations. Let % be a finite-dimensional Hilbert space with inner product (•, •) and || • || 
be the norm induced by the inner product over T~L. We denote the Euclidean norm by || • || 2 - Let 
$ : di —>• F m denote some known linear operator, where F is either M or C. 

Definition 1 (robust width property, [2]). We say a linear operator — > F m satisfies the 

(p, a)-robust width property over B j) if 

11*11 < p\\ x h 
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for every x £ H such that ||$a;|| 2 < a||x||; or equivalently if 

||$x|| 2 > a||x|| 

for every x € hi such that ||x|| > p||x||jj. Here, || • ||y is certain norm used to promote certain 
structured solutions to underdetermined systems of linear equations. 

2.2 Weaken-RIP property 

The RIP was originally introduced in (3j. In the latter, many researchers have contributed to the 
topic of RIP; for more information on its development, one could refer to |S]. Here, we write down 
the definition of RIP formulated in [5] . 

Definition 2 (RIP, [3j[5]). Let Sfc := {x £ M n , ||x||o < k} be the k-sparse vector set, where ||x||o 
stands for the number of nonzero components of vector x. A matrix T £ M rax " is said to have 
( k,5)-RIP property for sparsity k £ [n] := {1,2, ••• ,n} and distortion 0 < 5 < 1 if for every 
k-sparse vector in £&, it holds 

(1 - <5)|| x || 2 < I | rs || 2 < (1 + <5)|| x || 2 . 

The following is the definition of the weaken RIP appeared in [7j. 

Definition 3 (weaken-RIP, [7]). Let (ei, • • • , e n ) be the canonical basis of ML. A matrix T £ R mxn 
is said to have (k, a, f3)-weaken-RIP property for sparsity k £ [n] and distortions a,/3 > 0 if 

a) for every k-sparse vector in Y>k, ||rx|| 2 > a||x|| 2 and 

b) for every i £ [n], 11Te*11 2 < /3. 

Compared with the original RIP, the weaken-RIP are strictly weaker, as it suffices to verify the 
right-hand side of the RIP just for 1-sparse vectors and not for all s-sparse vectors [7j. Because of 
such relaxed restriction of the right-hand side of the RIP, the weaken-RIP contributes as a main 
reason for weakening moment assumptions in exact sparse recovery. In this note, we will show that 
the weaken-RIP also ensures stable and robust sparse recovery. Moreover, the idea behind of the 
weaken-RIP can widely apply to other instances in compressed sensing. In what follows, we try to 
state a generalized version of the weaken-RIP. To this end, let B be a collection of atoms such that 
the following holds 

H = {x £ H : x = a bb, CTb > 0, Mb £ £>}. 
beB 

We assume that B is centrally symmetric about the origin and consider the atom norm || • ||g induced 
by B. Recall that || • ||b has the following expression J4j: 

11 * 11 * = inf -£ a b : x = ^2 a bb,crb > 0, V6 £ £>}. 

beB beB 

Let k < n and define fc-simple subset relative to B as follows: 

k 

A := {x £ H : x = a- L bi,ai > 0, bi £ B}. 

i— 1 
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Before going forward, we give two well-known instances in compressed sensing. The first one is the 
sparse vector recovery, where we can take B = {±ei, ±e 2 , • • • , ±e n }, and then the corresponding 
A:-sirnple subset A relative to B is just the k-sparse vector set and the induced norm by B is the 
^i-norm. The second one is the low-rank matrix recovery, where we can take B = {uv T £ M nxn : 
||u|| 2 = ||u|| 2 = 1}, and then the corresponding fc-simple subset A relative to B is k-rank matrix 
set, and the induced norm by B is the Schatten ^i-norm. For more cases, please refer to [4]. 

Definition 4 (Generalized-weaken-RIP). Let A be a k-simple subset relative to B. A linear operator 
4> : LL —>• F m is said to have (k, a, (3)-generalized-weaken-RIP property for sparsity k £ [n] and 
distortions a, /3 > 0 if 

a) for every element in A, ||4>x|| 2 > a||x|| and 

b) for every element in B, ||4>x|| 2 < /3||x||. 

Note that the above definition on one hand is a generalization of the weaken-RIP, and on the 
other hand can also be viewed as a weaken version of the generalized RIP in [1]. 

Definition 5 (Generalized-RIP, pQ). Let £ be some subset of LI. A linear operator : Li —> ¥ m is 
said to have (k, a, (3)-generalized-RIP property for sparsity k £ [ n} and distortions a,/3 > 0 if 

a) for every element in £, ||<I>x||p > a||x ||<3 and 

b) for every element in £, ||<I>x||p < /?||x||g 
where || • ||p and || • ||g are certain norms. 

3 Main results 

Now, we state our main result: 

Theorem 1 (weaken-RIP implies robust width property). Let A be a k-simple subset relative to 
B, assume that each element b £ B satisfies ||6|| = 1, and take || • ||jj = || • \\&. If linear operator 
$ : LL F m has the (k,a, /3)-generalized-weaken-RIP property for sparsity 1 < k £ [n] and 
distortions a,/3 > 0, then it must have the ( p,a)-robust width property with 


(3 2 — a 2 
p 2 (k — 1) 

Proof. We divide the proof into two steps. 

Step 1: Let x be any nonzero element in LL ; then it has representations via the elements in 
B. Take one of its representations, say x = ° > 0,6 G 13. Let 7 = Ylb&B a b] ^ must 

be positive since a: is a nonzero element. Now, we prove the following inequality via the Maurey 
empirical method, which was employed to prove similar results in M: 

||$x||i > a 2 ||x|| 2 - (^VbWQbWl -o 2 ^(j 6 || 6 || 2N ) . ( 1 ) 

1 \beB b&B ) 
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Let Y be a random element in defined by 


P(y = 76) = —, 
7 


where b G B. Then, 


EY = ^ 76 

b&B 


&b 

7 


yy abb = x. 

b&B 


Let Y], Y 2 , •'' , Yfc be independent copies of Y and set z = i X)f=i Tj. Then, z £ d for every 
realization of Yi, Y 2 , • • • , Y^. By the definition of the ( k , a, /3)-generalized-weaken-RIP property, we 
have ll^zlH > a 2 ||z|| 2 and hence 

E[|$z||| > a 2 E||z|| 2 . 

It is straightforward to verify the following relationships: 

i) E(Y,Y) = 7 £ fe&B ^IH| 2 , 


ii) for every 1 < i < k, 

E^Y^Y,) = 7 ^a 6 ||$6|| 2 , 

b£B 


iii) and for each pair (i, j) satisfying 1 < i 7 ^ j < k, 

E {QYi^Yj) 


11**111 


Therefore, we have 


K 

E IMl = ^ E E <^,^> 

*7=1 

Similarly, it holds that 

k 

E IHI 2 = 4 E E < y ^> = 


k-l, 


W^ x \\2 + T^2^b\\^b\\ 2 . 


beB 


*7=1 


^IWIi + jj; 5 >l 

beB 


Substituting these two relationships to E||$z ||2 > a 2 E||z || 2 and rearranging terms, we obtain the 
desired inequality. 

Step 2: Apply the upper bound estimation in weaken-RIP and the robust width property to 
finish the proof. Notice that || 6 || = 1 and ||<hf>||| < /3 2 ||&|| 2 = /3 2 , the inequality (P) can be simplified 
into 

.211 „2 7 2 (/3 2 -« 2 ) 


||$x||2 > cr ||x|| — 


k-l 


(2) 


Since the expression of x is taken arbitrarily, we derive that 


ll**lli > sup 

X = J2beB <7bb,CTb>0 

2 ii 112 f 3 2 -a 

= a x — 




k-l 




h - 1 sup 

K 1 ®=£f, 6 B a bb,cr b >0 b( - B 

|2 ( q2 


-a 2 \\x\\ 2 -MM^1 
-a||x|| k _ i 
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where the last relationship follows from the expression of atom norm || • ||g. Therefore, for every 
x £ H satisfying ||x|| > p||x||b we get 


IMl > 



/3 2 — a 2 
p 2 (k — 1) 



which implies the (p, a)-robust width property. This completes the proof. 


□ 


It has been shown that the ( p , a)-robust width property is sufficient (and necessary up to 
constants) for uniformly stable and robust sparse recovery by convex minimization. Under the 
same setting of Theorem [TJ the ( k , a , /3)-generalized-weaken-RIP property is a stronger property 
and hence ensures uniformly stable and robust sparse recovery as well. In the following, we first 
introduce the concept of compressed sensing space, and then state a group of uniformly stable and 
robust sparse recovery results without proof details; they can be obtained directly by combining 
Theorem [0 with the stable and robust results in 

Definition 6. (J%j) A compressed sensing space (71, A, || • ||(j) with bound L consists of a finite¬ 
dimensional Hilbert space H, a subset A<£H, and a norm || ■ ||y on H with following properties: 

(i) 0 € A. 

(ii) For every a € A and v G H, there exists a decomposition v = z\ + such that 


o + zilln = IMItt + INI#> INI# < L \\ v h- 


Theorem 2 (weaken-RIP implies stable and robust recovery). Let A be a k-simple subset relative 
to B and assume that each element b £ B satisfies ||6|| = 1. Let || • ||g be the induced norm by B and 
|| ■ ||o be its dual norm. Suppose that there exists a bound L such that the triple ( H,A, || ■ ||g) is a 
compressed sensing space. If linear operator <I> : H —> F m has the (k,a, /3)-generalized-weaken-RIP 
property for sparsity 1 < k £ [n] and distortions a,/3 > 0, then 

a) for every x^ £ H,0 € (0,1), A > 0, a > 0 and w € F AI satisfying || < I ,T u;||o < 9Xa, any solution 
x* to the Lasso model 

minimize -||$>:r — (&x^ + w)\\\ + Afj||x||,B 

satisfies ||x* — a^|| < Collx 11 — a ||b + C\-a for every a £ A. Here, A is some turning parameter 
and a is a measurement of the noise level, and 


C 0 


1-0 



Ci 


(1 + 0)A 

a 2 p 


where a is given by Theorem [I] and the parameter p satisfies 


I /3 2 — a 2 
a 2 (k — 1) 


<p< 


1-6 
2 L ' 


b) for every x^ £ H and e € F AI with ||e ||2 < e, any solution x* to the basis pursuit model 

minimize ||x||b, subject to ||<3?x — (Qx^ + w )\\2 < e 
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satisfies \\x* — x^\\ < — a|| B + C3 ■ a for every a £ A. Here, 

C 2 = 2 p, C 3 = — 
a 

where the parameter p satisfies 

f3 2 - a 2 1 

a 2 (k — 1) < P < 4 L 

c) for every x^ £ H, A > 0, a > 0 and w £ F A/ satisfying ||<b T u;|| 0 < A a, any solution x* to the 
Dantzig selector model 

minimize ||x|| b, subject to ||<& T (<i>x — (4>x^ + u ;))|| 0 < Act 
satisfies \\x* — a^|| < C' 4||®' 1 — a||(j + C 5 • a for every a £ A. Here, 

C 4 

where the parameter p satisfies 
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^-l) \ C 5 = ^- 

Ip ) a z p 


P 2 -a 2 


a 2 (k — 1) <P< 2 L' 
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